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Network Information Flow in 
Small- World Networks 
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Abstract 

Recent results from statistical physics show that large classes of complex networks, both man-made 
and of natural origin, are characterized by high clustering properties yet strikingly short path lengths 
between pairs of nodes. This class of networks are said to have a small-world topology. In the context of 
communication networks, navigable small-world topologies, i.e. those which admit efficient distributed 
routing algorithms, are deemed particularly effective, for example in resource discovery tasks and peer- 
to-peer applications. Breaking with the traditional approach to small-world topologies that privileges 
graph parameters pertaining to connectivity, and intrigued by the fundamental limits of communication 
in networks that exploit this type of topology, we investigate the capacity of these networks from the 
perspective of network information flow. Our contribution includes upper and lower bounds for the 
capacity of standard and navigable small-world models, and the somewhat surprising result that, with 
high probability, random rewiring does not alter the capacity of a small-world network. 
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I. Introduction 



A. Small-World Graphs 

Small-world graphs, i.e. graphs with high clustering coefficients and small average path length, have 
sparked a fair amount of interest from the scientific community, mainly due to their ability to capture 
fundamental properties of relevant phenomena and structures in sociology, biology, statistical physics and 
man-made networks. Beyond well-known examples such as Milgram's "six degrees of separation" [3] 
between any two people in the United States (over which some doubt has recently been casted [4]) and 
the Hollywood graph with links between actors, small-world structures appear in such diverse networks 
as the U.S. electric power grid, the nervous system of the nematode worm Caenorhabditis elegans [5], 
food webs [6], telephone call graphs [7], citation networks of scientists [8], and, most strikingly, the 
World Wide Web [9]. 

The term small-world graph itself was coined by Watts and Strogatz, who in their seminal paper [10] 
defined a class of models which interpolate between regular lattices and random Erdos-Renyi graphs by 
adding shortcuts or rewiring edges with a certain probability p (see Figures Q] and [2]). The most striking 
feature of these models is that for increasing values of p the average shortest-path length diminishes 
sharply, whereas the clustering coefficient remains practically constant during this transition. 



Fig. 1. Small- world model with added shortcuts for different values of the adding probability p. 

Since small-world graphs were proposed as models for complex networks [10] and [11], most contri- 
butions in the area of complex networks focus essentially on connectivity parameters such as the degree 
distribution, the clustering coefficient or the shortest path length between two nodes (see e.g. [12]) . 
In spite of its arguable relevance — particularly where communication networks are concerned — the 
capacity of small-world networks has, to the best of our knowledge, not yet been studied in any depth by 
the scientific community. The main goal of this paper is thus to provide a preliminary characterization 
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Fig. 2. Small-world model with rewiring for different values of the rewiring probability p. 

of the capacity of small-world networks from the point of view of network information flow. 
B. Related Work 

Although the capacity of networks (described by general weighted graphs) supporting multiple com- 
municating parties is largely unknown, progress has recently been reported in several relevant instances 
of this problem. In the case where the network has one or more independent sources of information 
but only one sink, it is known that routing offers an optimal solution for transporting messages [13] — 
in this case the transmitted information behaves like water in pipes and the capacity can be obtained 
by classical network flow methods. Specifically, the capacity of the network follows from the well- 
known Ford-Fulkerson niax-flow min-cut theorem [14], which asserts that the maximal amount of a flow 
(provided by the network) is equal to the capacity of a minimal cut, i.e. a nontrivial partition of the graph 
node set V into two parts such that the sum of the capacities of the edges connecting the two parts (the 
cut capacity) is minimum. In [15] it was shown that network flow methods also yield the capacity for 
networks with multiple correlated sources and one sink. 

The case of general multicast networks, in which a single source broadcasts a number of messages to 
a set of sinks, is considered in [16], where it is shown that applying coding operations at intermediate 
nodes (i.e. network coding) is necessary to achieve the max-flow/min-cut bound of the network. In other 
words, if k messages are to be sent then the minimum cut between the source and each sink must be of 
size at least k. A converse proof for this problem, known as the network information flow problem, was 
provided by [17], whereas linear network codes were proposed and discussed in [18] and [19]. Max-flow 
min-cut capacity bounds for Erdos-Renyi graphs and random geometric graphs were presented in [20]. 

Another problem in which network flow techniques have been found useful is that of finding the 
maximum stable throughput in certain networks. In this problem, posed by Gupta and Kumar in [21], it 
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is sought to determine the maximum rate at which nodes can inject bits into a network, while keeping 
the system stable. This problem was reformulated in [22] as a multi-commodity flow problem, for which 
tight bounds were obtained using elementary counting techniques. 

Since the seminal work of [10], key properties of small-world networks, such as clustering coefficient, 
characteristic path length, and node degree distribution, have been studied by several authors (see e.g. [23] 
and references therein). The combination of strong local connectivity and long-range shortcut links 
renders small-world topologies potentially attractive in the context of communication networks, either to 
increase their capacity or simplify certain tasks. Recent examples include resource discovery in wireless 
networks [24], design of heterogeneous networks [25], [26], and peer-to-peer communications [27]. 

When applying small-world principles to communication networks, we would like not only that short 
paths exist between any pairs of nodes, but also that such paths can easily be found using merely 
local information. In [28] it was shown that this navigability property, which is key to the existence 
of effective distributed routing algorithms, is lacking in the small-world models of [10] and [11]. The 
alternative navigable model presented in [28] consists of a grid to which shortcuts are added not uniformly 
but according to a harmonic distribution, such that the number of outgoing links per node is fixed and 
the link probability depends on the distance between the nodes. For this class of small-world networks 
a greedy routing algorithm, in which a message is sent through the outgoing link that takes it closest to 
the destination, was shown to be effective, thus opening the door towards a capacity-attaining solution. 

C. Our Contributions 

We provide a set of upper and lower bounds for the max-flow min-cut capacity of several classes 
of small-world networks, including navigable topologies, for which highly efficient distributed routing 
algorithms are known to exist and distributed network coding strategies are likely to be found. Our main 
contributions are as follows: 

• Capacity Bounds on Small-World Networks with Added Shortcuts: We prove a high concentration 
result which gives upper and lower bounds on the capacity of a small-world with shortcuts of 
probability p, thus describing the capacity growth due to the addition of random edges. 

• Rewiring does not alter the Capacity: We construct assymptotically tight upper and lower bounds 
for the capacity of small-worlds with rewiring and prove that, with high probability, capacity will 
not change when the edges are altered in a random fashion. 

• Capacity Bounds for Kleinberg Networks: We construct upper and lower bounds for the max-flow 
min-cut capacity of navigable small-world networks derived from a square lattice and illustrate how 
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the choice of connectivity parameters affects communication. 
• Capacity Bounds for Navigable Small-World Networks on Ring Lattices: Arguing that the corners 
present in the aforementioned Kleinberg networks introduce undesirable artefacts in the computation 
of the capacity, we define a navigable small world network based on a ring lattice, prove its 
navigability and derive a high-concentration result for the capacity of this instance, as well. 
The rest of the paper is organized as follows. Section [TT] establishes some notation and offers precise 
definitions for the small-world models of interest in this work. Our main results are stated and proved 
in Sections III and IV, for classical and navigable networks, respectively. The paper concludes with 
Section |VJ 

II. Classes of Small-World Networks 

In this section, we give rigorous definitions for the classes of small-world networks under consideration. 
First, we require a precise notion of distance in a ring. 

Definition 1: Consider a set of n nodes connected by edges that form a ring (see Fig. |3j left plot). The 
ring distance between two nodes is defined as the minimum number of hops from one node to the other. 
If we number the nodes in clockwise direction, starting from any node, then the ring distance between 
nodes i and j is given by d(i,j) = min{\i — j\,n + i — j,n — \i — 

For simplicity, we refer to d(i,j) as the distance between i and j. Next, we define a /c-connected ring 
lattice. 




Fig. 3. Illustration of a k-connected ring lattice: from left to right k = 2,4, 12. 

The ring lattice that serves as basis for some of the small-world models described next, can be defined 
as follows. 

Definition 2: A k-connected ring lattice (see Fig. [3]) is a graph L = (Vl,El) with nodes Vl and edges 
El, in which all nodes in Vl are placed on a ring and are connected to all the nodes within distance |. 
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Notice that in a fc-connected ring lattice, all the nodes have degree k. We are now ready to define the 
targeted small-world models. 

Definition 3 (Small-World Network with Shortcuts [11], see Fig. [7]).- Consider a -connected ring lat- 
tice L = (Vl,El) and let Eq be the set of all possible edges between nodes in Vl- To obtain a 
small-world network with shortcuts, we add to the ring lattice L each edge e G Ec\El with probability 

P- 

Definition 4 (Small-World Network with Rewiring [10], see Fig. |2]): To obtain a small-world network 
with rewiring, we use the following procedure. Consider a ^-connected ring lattice L = (Vl,El) and 
choose a node, say node u, and the edge that connects it to its nearest neighbor in a clockwise sense. 
With probability p, reconnect this edge to a node chosen uniformly at random over the set of nodes 
{v € Vl ■ {u, v) £ El}- Repeat this process by moving around the ring in clockwise direction, considering 
each node in turn until one lap is completed. Next, consider the edges that connect nodes to their second- 
nearest neighbors clockwise. As before, randomly rewire each of these edges with probability p, and 
continue this process, circulating around the ring and proceeding outward to more distant neighbors after 
each lap, until each edge in the original lattice has been considered once. 

Definition 5 (Kleinberg Network [28], see Fig. 0).- We begin from a two-dimensional grid and a set 
of nodes that are identified with the set of lattice points in an n x n square, {(x, y) : x € {1, 2, n}, y € 
{1, 2, n}}, and we define the lattice distance between two nodes (x\, X2) and (yi, 1/2) to be the number 
of lattice steps (or hops) separating them: d(x, y) = \y\ — x\\ + \yi — xi\- For a constant h> 1, the node 
(ui,U2) (Vui,ii2 € {1, •-.,«}) is connected to every other node within lattice distance h (we denote the 
set of this initial edges as El). For universal constants q > and r > 0, we also construct edges from u 
to q other nodes using random trials; the i th edge from u has endpoint v with probability proportional to 
d(u, v)~ r . To ensure a valid probability distribution, consider the set of nodes that are not connected with 
u in the initial lattice, N u = {w : d(u,w) > h}, and divide d(u,v)~ r by the appropriate normalizing 

constant s(u) = Eu,eJvJ^( M ' w )]~ r ■ 

In the next section, we will see that this model exhibits unexpected effects related to the corners of 
the chosen base lattice. Motivated by this observation, we construct a somewhat different model, which 
uses a ring lattice but still keeps the key relationship between shortcut probability and node distance that 
assures the navigability of the model (as proven in the appendix). 

Definition 6 (Navigable Small-World Ring): Consider a ^-connected ring lattice. For universal con- 
stants q > and r > 0, we add new edges from node i (Vz) to q other nodes randomly: each 
added edge has an endpoint j with probability proportional to d(i,j)~ r . To ensure a valid probability 
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Fig. 4. Kleinberg network. Each node is directly connected to all neighbors within h hops, and also to q more distant nodes 
through so called shortcuts. In the shown example, where h = q = 1, lightly shaded circles represent the nodes that are directly 
connected to node i.e. the four direct neighbors of (i, j) and one additional node (k,l) connected by a shortcut. 



distribution, consider iVj = {j : d(i,j) > §} and divide d(i,j) r by the appropriate normalizing constant 

III. Capacity Results for Small-World Networks 

In Section II-BI we argued that the max-flow min-cut capacity provides the fundamental limit of 
communication for various relevant network scenarios. Motivated by this observation, we will now use 
network flow methods and random sampling techniques in graphs to derive a set of bounds for the capacity 
of the small-world network models presented in the previous section. Although all of the models discussed 
in this section are based on ring lattices, it is worth pointing out that the methodology presented next 
can be equally applied to other classes of base lattices. 

A. Preliminaries 

We start by introducing some necessary mathematical tools. Let G be an undirected graph, representing 
a communication network, with edges of unitary weight. In the spirit of the max-flow min-cut theorem 
of Ford and Fulkerson [14], we will refer to the global minimum cut of G as the max-flow min-cut 
capacity (or simply the capacity) of the graph. 

Let G s be the graph obtained by sampling on G, such that each edge e has sampling probability p e . 
From G and G s , we obtain G w by assigning to each edge e the weight p e , i.e. w(e) = p e ,Ve. We 
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denote the capacity of G s and G w by c s and c w , respectively. It is helpful to view a cut in G s as a sum 
of Bernoulli experiences, whose outcome determines if an edge e connecting the two sides of the cut 
belongs to G s or not. It is not difficult to see that the value of a cut in G w is the expected value of the 
same cut in G s . The next theorem gives a characterization of how close a cut in G s will be with respect 
to its expected value. 

Theorem 1 (From [29]): Let e = y/2(d + 2) \n[n)/c w . Then, with probability 1 — 0(l/n d ), every cut 
in G s has value between (1 — e) and (1 + e) times its expected value. 

Notice that although d is a free parameter, there is a strict relationship between the value of d and the 
value of e. In other words, the proximity to the expected value of the cut is intertwined with how close 
the probability is to one. Theorem [7] yields also the following useful property. 

Corollary 1: Let e = y/2(d + 2) ln(n)/cu,. Then, with high probability, the value of c s lies between 
(1 - e)c w and (1 + e)c w . 

Before using the previous random sampling results to determine bounds for the capacities of small-world 
models, we prove another useful lemma. 

Lemma 1: Let L = (Vl,El) be a /c-connected ring lattice and let G = (Vl,E) be a fully connected 
graph (without self-lops), in which edges e G El have weight w\ > and edges / ^ El have weight 
W2 > 0. Then, the global minimum cut in G is kw\ + (n — 1 — k)w2- 

Proof: We start by splitting G into two subgraphs: a /c-connected ring lattice L with weights w\ and 
a graph F with nodes Vl and all remaining edges of weight W2- Clearly, the value of a cut in G is the 
sum of the values of the same cut in L and in F. Moreover, both in L and in F, the global minimum cut 
is a cut in which one of the partitions consists of one node (any other partition increases the number of 
outgoing edges). Since each node in L has k edges of weight w\ and each node in F has the remaining 
n — 1 — k edges of weight W2, the result follows. ■ 

B. Capacity Bounds for Small-World Networks with Added Shortcuts 

With this set of tools, we are ready to state and prove our first main result. 

Theorem 2: With high probability, the value of the capacity of a small-world network with added 
shortcuts lies between (1 — e)c w and (1 + e)c w , with e = \f2(d + 2) \n{n)/c w and c w = k + (n — 1 — k)p. 

Proof: Let G w be a fully connected graph with n nodes and with the edge weights (or equivalently, 
the sampling probabilities) defined as follows: 

• The weight of the edges in the initial lattice of a small-world network with added shortcuts is one 
(because they are not removed); 
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• The weight of the remaining edges is p, (i.e. the probability that an edge is added). 
Notice that G w is a graph in the conditions of Lemma |7] with w\ = 1 and W2 = p- Therefore, the global 
minimum cut in G w is c w = k + (n — 1 — k)p, where k is the initial number of neighbors in the lattice. 
Using Corollary the result follows. ■ 

The obtained bounds are illustrated in Fig. [5] 




Fig. 5. Bounds on the capacity of a small-world network with added shortcuts, for n = 1000, k — 20, and d = 1. The dashed 
line represents the expected value of the capacity, and the solid lines represent the bounds. Naturally, the capacity increases with 
p, as the number of added links become larger. 



C. Capacity Bounds for Small-World Networks with Rewiring 

In the previous classes of small-world networks, edges were added to a fc-connected ring lattice (with 
minimum cut k) and clearly the capacity could only grow with p. The next natural step is to ask what 
happens when edges are not added but rewired with probability p, as described in Section HH Before 
presenting a theorem that answers this question, we will prove the following lemma. 

Lemma 2: Let G w be a weighted, fully connected graph, whose weights correspond to the edge 
probabilities of a small-world network with rewiring, and let c w be the global minimum cut in G w . 
Then, c w > k. 

Proof: We start with the initial lattice edges (l,m) £ El, and assign the weight 1 — p to their 
counterparts in G w . In order to determine the weight of the non-initial edges that result from rewiring, 
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consider the following events: 

• R(i,j): "Choose the edge £ El to be rewired"; 
. Ci(j,l): "Rewire € E L to $ E L ". 

Notice that V(R(i,j)) =p,V(i,j) € E L . 

Let i and j be two non-initially connected nodes. The notation i <-> j denotes the event that the nodes z 
and j are connected. We have that 

V(i <- j) = V (\\J k J* x {R{i,i + x) n d(i + x, j))) U [U k J^(R(j,j + x) n Cjij + x,i)))) 

= v (u k J^{R(i, i + x)nCi(i + x,j)))+ v(u k x ^(R(j,j + x)n c^j + x, »))) 
-P ([u^i^, i + x) n Ci(i + x, j))] n [u^ 2 1 (i?(j, j + x ) n + x, %))}) 

Because we do not consider multiple edges, we have that the events R(i,i + x) n Ci(i + x,j) and 
+ y) n Cj(j + y, i) are mutually exclusive, Vx, y. Therefore, 

fc/2 

^(^j) = ^(P(^(i,i + x)nc J (i + x,i))+p(i?(j,i + x)nc i (i + x,i))) 

as=l 
fe/2 

= E + x >j)\ R & i + *))*W> i + x))+ V{Cj{j + x, i)\R(j,j + x))V(R(j,j + x))) 

x=l 

/fe/2 \ 

= V \^(V(Ci(i + xJ)\R(i,i + x)) +V(C j (j + x,i)\R(jJ +x)))\ . 

We have V(Ci(i + x, j)\R(i,i + x)) = -j-, where m is the number of possible new connections from 
node i when we rewired the edge + x). It is possible that, occurring some rewiring or not, none of 
the choices to a new link is the node i. In this case, m = n — k — 1. Notice that this is the highest it can 
get, therefore m < n — k — 1. Then, we have 

V(Ci(i + x,j)\R(i,i + x)) > ) -. 

n — k — 1 

Analogously, V(Cj{j + x,i)\R(j,j + x))) > n _\_ v Therefore, 

/fe/2 



V(i <- j) > v ■ \ Y. 



2 \ pk 



- n — k — 1 / n — k — 1 
\x=l 

There are k initial edges and n — k — 1 non-initial edges in each node. 

Consider a fully connected, weighted graph F with the weights defined as follows: all the edges 
£ El have the weight n ^_ 1 , and all the others edges G El have the weight 1 — p. Notice 
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that F is a graph in the conditions of Lemma 1, with w± = 1 — p and W2 = n \-v Therefore, 

cf = k(l — p) + in — k — 1) — = k. 

n — k — 1 

Notice that, in this situation, all the weights in F are a lower bound of the weights in G w . Therefore, 
a cut in F is a lower bound for the corresponding cut in G w . Then, the global minimum cut in F is a 
lower bound for all the cuts in G w , in particulary, for c w : c w > cf = k. ■ 
With this lemma, we are now ready to state and prove our next result. 

Theorem 3 (Rewiring does not alter capacity.): With high probability, the capacity of a small- world 
network with rewiring has a value in the interval [(1 — e)k, k] with e = \/2(d + 2)ln(n)/k. 

Proof: Based on Lemma\2\and Corollary^ we have that, with high probability, c s > (l — e w )k, with 
e w = y/2(d + 2)ln(n)/c w . Now, from the fact that c w > k, we have that e = y / 2(d + 2)ln(n)/k > e w . 
Then, (1 — e w )k > (1 — e)k, and the first part of the result follows. 

Next, we prove by contradiction that c s < k. Suppose that the proposition c s > k is true. Let q be 
the cut in which one of the partitions consists of node i, i = 1, ...,n. Because c s is the global minimum 
cut in G s , we have that Cj > k, Vi = 1, n. Notice that q is the degree of node i. Then, because in the 
fe-connected ring lattice all nodes have degree k and all nodes in G s have degree greater than k (because 
Cj > k,\/i), we have that the number of edges in G s must be greater than the number of edges in the 
/c-connected ring lattice. But this is clearly absurd, because in the construction of G s , we do not add 
new edges to the /c-connected ring lattice, we just rewire some of the existent edges. ■ 

IV. Capacity Bounds for Navigable Networks 

As we argue in Section H when considering small-world networks as communication networks, an 
important aspect is the ability to find short paths between any pairs of nodes, using only local information. 
This property guarantees that efficient distributed routing algorithms exists. Kleinberg, in his seminal work 
[28], proved that this navigability property is lacking in the models of Watts and Strogatz, and introduced 
a new model (Definition [3]). Motivated by the relevance of the navigability property, we present, in this 
section, the capacity bounds for Kleinberg Networks and for Navigable Small-World Rings. 

A. Capacity Bounds for Kleinberg Networks 

Before proceeding with the bounds for the capacity of Kleinberg networks, we require an algorithm 
to calculate the normalizing constants s(x,y) = j)&N (x v) [d((x, y), (i, j))]~ r for x,y e {l,...n}. For 
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this purpose, we note that the previous sum can be written as 

s(x,y)= Yl ld(^j)Ax,y)T r - £ [d((i,j),(x,y))]~ r . 

Clearly, the first term can be easily calculated. Thus, the challenging task is to present an algorithm that 
deals with the calculation of J2(i j)£Nr x y) [^((*> j)i ( x ' v))\~ r ■ The nodes £ N( x ^ are the nodes 

initially connected to node (x, y), i.e., the nodes at a distance t < h from node (x, y). It is not difficult to 
see that the nodes at a distance t from node (x, y) are the nodes in the square line formed by the nodes 
(x — t, y), (x + t, y), (x, y + t) and (x, y — t). Then, we could just look at nodes in the square formed 
by the nodes (x — h, y), (x + h, y), (x, y + h) and (x, y — h) and sum all the corresponding distances to 
node (x,y). A corner effect occurs when when this square lies outside the base lattice. Assume that we 
start by calculating the distances to the nodes in line y + i, with i > 0. 

To avoid calculating extra distances (i.e., distances of nodes that are out of the grid), we must make 
sure that this line verifies y + i < n and also y + i < h. For this reason, i must vary according to 
i 6 {0 . . . min{/i, n — y}}. Now, in each line y + i, we first look at the nodes in the right side of (x, y), 
i.e., we calculate the distances of the nodes (x + j,y + i), with j > 0. Now, notice that in the line y, 

TABLE I 

Algorithm for computing normalizing constants 
Algorithm 1: 

Z = [0] n X n 

for i — : min{h, n — y} 

for j = : min{h — i,n — x} 
z(x + j,y + i) = (i + j)~ r 
for j — 1 : min{h — i, x — 1} 
z(x- j,y + i) = (i+.fr r 
for i = l: min{h, y — 1} 

for j = : min{h — i,n — x} 
z{x+j,y-i) = (i+.fr r 
for j — 1 : min{h — i,h — (mi — i),x — 1} 
z(x-j,y- i) = (i+j)~ r 
z(x,y) = 

2 = Er=i£"=iz(M) 

s(x,y) = 'E(i, j )^( X ,v)(\ i - x \ + \j - v\y r - z 
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we have h points on the right side of (x, y) that are in the square (regardless of whether they are in 

the grid). Because the distance is the minimum number of steps in the grid, we have that in line y + i 

there are h — i points at the right side of (x,y) that are inside the square. This way, j must be vary 

according to j G {0 . . . mm{h — i, n — x}}. Now, when looking at the nodes at the left side (i.e., the nodes 

(x — j,y + i), with i > 1), the idea is the same. The only difference is that, in this case, the variation for 

j is j G {1 . . . mm{h — i,x — 1}}. Then, we proceed analogously for the lines below (x, y), i.e., the lines 

y — i, with i G {1 . . . min{/i, y — 1}}. This algorithm is summarized in Table HI The matrix z is a buffer 

for the distances, i.e., z(u\,U2) = d((x,y), (lii,-^)). We impose z(x,y) = 0, because d((x,y), (x,y))~ r 

is also calculated in this procedure. 

The following quantities will be instrumental towards characterizing the capacity: 

(h(h + 3) ,„ 
M = max <^ — - + q, (1 - e)c h 



e = v / 2(d + 2)ln(n 2 )/c w 

hfh _i_ h+l n n n 

C W = + ^ £ f{x>v)+ £ ^f( X ,y) (1) 

x=l y=h+2—x x=h+2 y=l 

f{x,y) = q- {g^y) (1,1) (x, y)) 

{x + y -2)- r \ q ~ 1 (x + y-2)- r 



9(x, y )(a,b) = ^1 



s(a, b) J s(a, b) 

n— 1 n—2 
s (l, 1) = ^ (» + 1) . i~r + J^( n _ 1 _ i) . („ + i)-r. 

i=/i+l «=0 

Recall that s(x,y) can be calculated using Algorithm 1. The proof of the capacity will rely heavily on 
the following lemma. 

Lemma 3: Let G w be the weighted graph associated with a Kleinberg network, and c w be the global 
minimum cut in G w . Then, for h < n — 1, c w is given by (Q]). 

Proof: All the edges e G have weight 1 (because they are never removed), all nodes in G w 
have degree n 2 — 1, and the weights of these edges depend only on the distance between the nodes they 
connect. Therefore, the global minimum cut in G w must be a cut in which one of the partitions consists 
of a single node. Because the weight of an edge in G w decreases with the distance between the nodes 
that it connects, the global minimum cut in G w must be a cut in which one of the partitions consists 
of a single node that maximizes the distance to other nodes. Therefore, because a corner node has more 
nodes at a greater distance than the other nodes and has also a smaller number of nodes to which it is 
connected, c w must be a cut in which one of the partitions consists of a corner node: (1, 1), (1, n), (n, 1) 
or (n, n). 
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Assume, without loss of generality, that c w is the cut in which one of the partitions consists of 
node (1,1). Let w(u,v) be the weight of the edge connecting the nodes u and v. This way, c w = 
Ylu^ti 1) w (0-> 1)' u )- Now, we must count how many edges connecting node (1, 1) are in El, therefore, 
having weight 1. For this, we define an auxiliary way to numerate diagonals: {(1,1)} is the diagonal 0, 
{(1, 2), (2, 1)} is diagonal 1, and so on (see Figure [6]). 




Fig. 6. Numeration of the diagonals of a square lattice. 



It is not difficult to see that the nodes in the i th diagonal have a distance i to node (1,1), i € 
{1, 2(n — 1)}. Now, for i < n — 1, there are i + 1 nodes in the i th diagonal and, for i = n + j with 
j € {0, n — 2}, there are n — 1 — j nodes in the i th diagonal. Then, there are Yli=i * + 1 = h(h + 3)/2 
nodes initially connected to node (1, 1) (again, with h < n — 1), then there are h(h + 3)/2 edges with 
weight 1. Therefore, we have that: 

„\ h+l n n n 

c w = ^ r A + Y. E "((m), (*,»)) + E £"((m)> (*,»))■ 

x=l j/=/i+2— x x=h+2 J/=1 

Next, we determine the weights, w(u,v). Consider two nodes that are not connected initially, u = 
(u\,U2) and v = (^1,^2), and the edge (u,v). This edge can be added in two different trials: one for 
node u and another one for node v. Because we do not consider multiple edges, these can be viewed as 
two mutually exclusive trials. Therefore, the weight of this edge is the sum of the probabilities of adding 
this edge when considering node u and when considering node v. Let us focus on node u. The trial "add 
edge (u, v)" follows a Binomial distribution, with q Bernoulli experiences, with success probability 

_ d(u,v)~ r _ (jvg - Vj\ + \U2 - V2\)~ V 

a U\ V ) — ( N. — I ^ 

s\u) s[u) 
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Therefore, the probability of adding the edge (u, v), when considering node u, is q ■ (1 — a u (v)) q 1 • a u (v). 
Therefore, the weight of the edge ((7/1,7/2), (fi,^)) is 

w(u, v) = q ■ (1 - a u (v)) q ~ 1 ■ a u (v) + q ■ (1 - a u (it)) 9_1 • a t ,(ii). 

As we have seen, the global minimum cut in G w is the cut in which one of the partitions consists of 
node (1, 1). We have that, if (x, y) is a node of the grid, x > 1 and y > 1. Then, d((l, 1), (x,y)) = 
|z- 1| + |y- 1| = x + y-2. Therefore, a (1)1) (x, y) = and a^(l, 1) = ^r^y- Now, observing 

that we can calculate s(l, 1) as 

n— 1 n—2 

S (l,l)= 2 (i + l)-r r + 5>-l-i)-(n + i)~ r 

i=/l+l i=0 

and using expression £[]) for c w , the result follows. ■ 
We are now ready to state our main result. 

Theorem 4: For h < n — 1 the capacity of a Kleinberg small-world network graph lies, with high 
probability, in the interval [M, (1 + e)c w ]. 

Proof: Using Lemma\3\m& Corollary^ we have that, with high probability, c s £ [(1 — e)c w , (1 + e)c u 
A tighter lower bound can be obtained for c s as follows. Each node has a number of initial edges, 
determined by h, and q additional shortcut edges. The nodes with less initial edges are obviously the 
corner nodes, which exhibit fe ^ 2 +3 - > initial connections. Therefore, we have that c s > + g 5 and the 

result follows. ■ 

The bounds of Theorem @ are illustrated in Fig. [7] 

B. Capacity Bounds for Navigable Small-World Rings 

As we have seen, Kleinberg's model exhibits corner's effects in terms of capacity. With the goal of 
overcoming this problem, we defined a new class of small-world networks, the navigable small-world 
ring (see Definition [6] in Section [EI]), whose navigability is proven in the appendix. Now we study the 
capacity of this class of networks by proving the following result. 

Theorem 5: With high probability, the capacity of the navigable small-world ring has a value in the 



interval [max {A;, (1 — e)c w )} , (1 + e)c w )], with e = y/2{d + 2) ln(n)/c w and 



-1 

c w = k + 2 rq+l s~ q q{l + a n )(n - a n )~ r (2~ r s - (n - a n )- r ) q - 1 + Aqs~ q ■ 



9-1 , V- r r (s _ r ry-l 



l-(-l)" 



with s = (1 + a re ) ■ ( n ^) + 2 • £ r r , where a n - 
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Fig. 7. Bounds for the capacity of Kleinberg small-world network for n — 80 (i.e. 1600 nodes), h = 2, r — 2 e d = 1, and 
different values of the shortcut parameter q. The white dots represent the expected value of the capacity and the dark dots 
represent the bounds computed according to Theorem [?] 



Proof: Consider the fully connected graph G w = (Vl,E) associated to the navigable small-world 
graph. The task is to determine the weights of the edges of G w . The edges e € El have weight 1, because 
we never remove them. Now, notice that the ring distance between two nodes does not depend on which 
node is numbered first. It is therefore correct to state that all the nodes have the same number of nodes 
at a distance d. Therefore, we have that the normalizing constants are equal, for all nodes: s, = Sj,\/i,j. 
Let s = Si. We also have that the weight of each edge only depends on the distance between the nodes 
that it connects. Therefore, it is sufficient to determine the weights of the edges of a single node, say 
node 1. 

First, we must compute the normalizing constant s. We must distinguish between two different situa- 
tions: even n or odd n. If n is even, it is not difficult to see that there is a single node that maximizes the 
distance to node 1. That node is node § + 1, and we have that d (l, § + l) = \. For distances d < § , 
there are two nodes at distance d to node 1. Therefore, if n is even, we have that 

.=(=r +a -£.-. 

When n is odd, it is also easy to see that there are two nodes that maximize the distance to node 1: 
nodes and with the maximum distance being Therefore, if n is odd, we have that 
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Now, just notice that a n = 1 ^ 2 ^ is equal to if n is even, and it is equal to 1 if n is odd. Therefore, 

S = (l + a n )-(^V r + 2. £ i-r. 

j=|+i 

Consider a node that is not initially connected to node 1, say node i. The edge (1, i) can be added 

in two different trials: one for node 1 and another for node i. Because we do not consider multiple 

edges, these two trials are mutually exclusive. Therefore, the weight of the edge (1,«) is the sum of 

the probabilities of adding this edge when looking at node 1 and when looking at node i. Because the 

normalizing constant is the same for all nodes, these two probabilities are equal. This way, let us focus 

on node 1. The trial "add edge follows a Binomial distribution, with q Bernoulli experiences and 

with success probability p = — . Therefore, the probability of adding edge (l,i) when considering 

node 1 is qp ■ (1 — p) 9-1 . Therefore, the weight of the edge (1, i) is 

/ \ d(l,i)- r ( d(l,i)- rX " _1 

w(l,i) = 2q- V ' • 1 



s \ s 

We have seen that all the nodes have the same number of nodes at a distance d. We also have that all 
the edges in the ring lattice have unitary weight. Based on these two observations and the fact that G w 
is a fully connected graph, it is clear that the global minimum cut in G w , denoted c w , is a cut in which 
one of the partitions consists of a single node, say node 1. Thus, we may write 



k+ 



fc + 2(l + a n )q 




9-1 , V- i -rf_ i -ry-l 



-1 

k + + «n)(n - a n )~ r {2~ r s - (n - a )1 )- r ) ? " 1 + 4qs~ q ■ 

i=|+i 

Now, using Corollary [7] and noticing that, because we only add new edges to the initial /c-connected 
ring lattice and this lattice has capacity k, the capacity can only be greater than k, we obtain the desired 
bounds. ■ 
The result is illustrated in Fig. [U 
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Fig. 8. Bounds for the capacity of a navigable small-world ring for n — 1600, k = 14, r = 1 e d = 1, and different values of 
the shortcut parameter q. The white dots represent the expected value of the capacity and the dark dots represent the bounds 
computed according to Theorem\5\ 



V. Concluding Remarks 

We studied the max-flow min-cut capacity of four fundamental classes of small-world networks. 
Using classical network flow arguments and concentration results from random sampling in graphs, we 
provided bounds for both standard and navigable small- world networks with added shortcuts, and also 
for Kleinberg's model. In addition, we presented a tight result for small-world networks with rewiring, 
which permits the following interpretation: With high probability, rewiring does not alter the capacity of 
the network. This observation is not obvious, because we can easily find ways to rewire the ring lattice 
in order to obtain, for instance, a bottleneck. But, according to the previous results, such instances occur 
with very low probability. 

In [28], Kleinberg explains that, in order to obtain a probability distribution, d((u\, U2), (v\, V2))~ r 
should be divided by Yl( Vl v 2 )^(u 1 u 2 ) n 2)> (vi,V2))]~ r ■ As we have shown, the previous expression 

is not an accurate normalizing constant for our work, because we consider undirected edges. Then, the 
candidates for new connections from node (?ii,it2) are not all the nodes of the base lattice, but only 
those nodes that are initially not connected to node {u\,U2). 

Possible directions for future work include tighter capacity results, extensions to other classes of small- 
world networks (e.g. weighted models and those used in peer-to-peer networks [27]), and understanding 
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if and how small-world topologies can be exploited in the design of capacity-attaining network codes and 
distributed network coding algorithms. At a more conceptual level, we are intrigued by the possibility 
that the notion of capacity may help us answer a very central question: why small-world topologies are 
ubiquitous in real-world networks. 

Appendix 

Proof of Navigability of the Small-World Ring 

As we have discussed in Section H in the context of communication networks, we would like that not 
only short paths exist between any pair of nodes, but also that paths can easily be found using only local 
information. Kleinberg, in [28], showed that this navigability property is absent in the initial models of 
small-world networks, from Watts and Strogatz. This way, Kleinberg felt the need to introduce a new 
model, the model defined in Definition \5\ that captures this fundamental property. In his work, Kleinberg 
uses the idea of a decentralized algorithm to study the navigability property. 

Definition 7: Consider a graph G with an underlying metric 8g- A decentralized algorithm in G is an 
algorithm with the goal of sending a message from a source to a destination, with the knowledge, at each 
step, of the underlying metric, the position of the destination, and the contacts of the current message 
holder and of all the nodes seen so far. 

Definition 8: A greedy decentralized algorithm is a decentralized algorithm operating greedily: at each 
step, it sends the message to the contact of the current message holder that is closer (in the sense of the 
underlying metric) to destination. 

In [28], Kleinberg proved that the models presented by Watts and Strogatz do not admit efficient 
decentralized algorithms, in constrast with his model: 

Theorem 6 (From [28]): For r = 2, there is a constant a^, independent of n, so that the expected 
delivery time of a greedy decentralized algorithm in a Kleinberg network is at most «2 ■ log 2 (ra). 

Theorem 7 (From [28]): 

1) Let < r < 2. There is a constant a r , depending on p, q, r, but independent of n, so that the 
expected delivery time of any decentralized algorithm in a Kleinberg network is at least a r -n^ 2 ~ r ^ 3 . 

2) Let r > 2. There is a constant a r , depending on p, q, r, but independent of n, so that the expected 
delivery time of any decentralized algorithm in a Kleinberg network is at least a r ■ n^ r ~ 2 '^ r ~ 1 \ 

Theorem |6| shows that, in fact, a Kleinberg network is navigable, while Theorem [7| shows that the 
models from Watts and Strogatz are not navigable, because this is the case when we consider uniformly 
chosen shortcuts, therefore corresponding to r = 0. 
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The next theorem shows that a navigable small-world ring is, indeed, navigable, in the sense that the 
expected delivery time of a decentralized algorithm is logarithmic. The proof is essentially based on the 
proof of Theorem \6\ presented by Kleinberg. 

Theorem 8: For r = 1, the expected delivery time of a greedy decentralized algorithm in a navigable 
small- world ring is at most 1 " n ^"^ . 

Proof: First, we need to show that Ylu^N d{u,v)~ l is uniformly bounded. For even n, it is not 
difficult to see that there is a single node that maximizes the distance to node 1. That node is node § + 1, 
and we have that d (l, ^ + l) = ^. For distances d < there are two nodes at distance d to node 1. 
Therefore, if n is even, we have that 

When n is odd, it is also easy to see that there are two nodes that maximize the distance to node 1: 
nodes ^±1 and with the maximum distance being Therefore, if n is odd, we have that 

n—l 

d(u,vy l = 2- £ r 1 . 

u(£N v i=$+l 



Therefore, we have that Vn GN, 



< 2- V i 



^ r 1 

i=l 

< 2 + 21n^- 

< 21n(2n). 

For j > 0, we say that the decentralized algorithm is in phase j if the distance between the current 
message holder and the destination is d such that 2 J 1 < d < 2 J+1 . We say that the algorithm is in phase 
if the distance between the current message holder and the destination is at most 2. Because the maximum 
distance in the ring-lattice is at most S, we have that j < log (S). 

Now, suppose that we are in phase j and the current message holder is node u. The task is to determine 
the probability of phase j ending in this step. Let Bj be the set of nodes within lattice distance 2 J of the 
destination. Phase j ending in this step means that u chooses a long-range contact v £ Bj. Each node 
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v € Bj as probability of being chosen as long-range contact of u at least 



E^jv„ d(u,v)- 1 ~ 2^'+ 1 -ln(2n)- 
We have that the number of nodes in Bj, denoted by \Bj\, verifies 

\B}\ = l + 2-^i> 2 2j . 

i=l 

Therefore, with A denoting the event "Phase j ends in this step", we have that 

2 2 3 03 ; -l 1 



• ln(2n) ln(2n) ~ ln(2n) ' 
Let Nj be the number of steps spent in phase j. Now, we must compute the expected value of Nj. 

Notice that the maximum number of steps spent in phase j is the number of nodes at distance of the 

destination d such that 2 J < d < 2 J+1 , which is 



2 j+i_i 
m = 2 ■ i 

/2 J+1 -1 2 3 -l 

V 

i=l i=l 



- H E «-£ 

\ i=i i=i / 
= 2 J ' +1 (2 J ' +1 -l)-2^'-l) 

< 2 2 ^'+ 2 . 

Therefore, the expected value of iVj verifies the following: 

m 
i=l 

223 + 2 

i=l 

Q2j + 2 . -. 

< VCi-— V 

OO / 1 N j— 1 

< 



i=l 

ln(2n). 



ln(2ra) 



Now, denoting by N the total number of steps spent by the algorithm, we have that 

Mi) 

N= £ N r 



i=0 
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Therefore, by linearity of the expected value, we have that 




E(N) 



i=0 



< 



(l + logQ)) -1h(2ti) 



(log(2)+log (-)) -ln(2n) 



log(n) • ln(2n) 
ln(n) • ln(2n) 



ln(2) 



< 



ln 2 (2n) 
ln(2) 
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